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Abstract 

In this paper we introduce the discontinuous universal feedback for the problem of 
Nash equilibrium in two person non-zero sum differential game. We assume that there 
exist functions satisfying some conditions analogous to the infinitesimal conditions on value 
function in zero sum differential games. Under this assumption we prove the existence of 
universal feedback Nash equilibrium. 
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1 Introduction 

In this paper we introduce the discontinuous universal feedback for the problem of 
Nash equilibrium in two person non-zero sum differential game. This approach is close to 
the extremal shift rule suggested by N.N. Krasovskii and A.I. Subbotin for the zero-sum 
differential games. The extremal shift rule was suggested in [1] to prove the existence of 
value function. The value function of zero sum differential game is the viscosity solution 
of corresponding Hamilton-Jacobi equation. The universal feedback synthesis is based on 
the properties of value function and the definition of viscosity solutions. N.N. Krasovskii 
designed the universal feedback e-strategies [2]. His scheme use the minimization of the 
value function of the game in e-neighborhood. A.I. Subbotin introduced the universal 
feedback using the notion of quasigradient [3|, [!]■ In the paper of F. H. Clarke, Yu. S. 
Ledyaev, and A. I. Subbotin [5] the aiming in the direction of proximal subgradients of the 
value function was studied. Constructed strategy is universal also. 

The problem of Nash equilibrium in the differential game is connected with the Cauchy 
problem for the system of Hamilton-Jacobi equations [6j. In the general case the Hamilto- 
nians are discontinuous. If the smooth solution of Cauchy problem exists and the controls 
of players are continuous then there exists universal feedback Nash equilibrium. If the so- 
lutions doesn't exist or it isn't smooth then the situation becomes more complicated. A 
particular case when the universal feedback Nash equilibrium exists were considered by P. 

*The work is supported by RFBR (grant No 09-01-00436-a), Grant of President of Russian Federation (project 
MK-7320. 2010.1), RAS Presidium Program of Fundamental Researches "Mathematical Theory of Control". 
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Cardaliaguet and S. Plaskacz [7J. The approach based on the solution of the system of con- 
servation laws is developed by A. Bressan and W. Shen [8], [9]. They study one dimensional 
games under condition of hyperbolicity and design the universal feedback strategies. 

In this paper we consider the general case of finite horizon non-zero sum differential 
game. We assume that there exist functions satisfying some conditions analogous to the 
infinitesimal conditions on value function in zero sum differential games [3J, [S]. Under this 
assumption we prove the existence of universal feedback Nash equilibrium. 



2 Definitions and Designations 

We consider the doubly controlled system 

x = f(t,x,u,v), ie[i ,#o], xeR n , ueP, veQ. (l) 

Here u and v are controls of the Player I and the Player II respectively. The purposes of 
the Players are nonantagonistic. The Player I wants to maximize the functional 

A 1 (x(-), «(•),«(■)) = <n(x(# )) + J 9iti,x(0M0X0)dti, 
the Player II wants to maximize the functional 

A 2 (x(-), u(-), «(■)) = ff 2 (x(i?o)) + / 92& x(OMOMO)d^- 



We assume that the sets P and Q are compacts, the function /, u\ and o"2 are continuous, 
moreover /, g\ and g<i are Lipschitz continuous with respect to the phase variable, and satisfy 
the sublinear growth condition with respect to x. 

We use the discontinuous feedback control scheme first suggested by N.N. Krasovskii for 
zero-sum differential games. We consider the two cases: 

• the Players choose feedback strategies and make consistent the corrective moments; 

• one of the Players deviates. 

Feedback strategy of the Player I is a function U(t, x) with values in P, feedback strategy 
of the Player II is a function V(t,x) with the values in Q. 

Let us consider the first case. We assume that the Player I chooses the strategy U, 
the Player II chooses the strategy V. Let (t*,x*) be an initial position. Suppose that the 
Players choose the partion of time segment [t*,i?o] A = {t/ c }^L 1 . Further let d(A) denote 
the fineness of partition A. Let x c [-, t*,x*, U, V, A] be an unique solution of the problem 

x[t]=x[Ti}+ f(Z,x[t!],u(Ti,x[Ti]),v(Ti,x[Ti\))dt, * € |>,j , Ti+l ) , % = 0, 771 - 1, x[t*\ = X*. 

The value of cost functional of i-th Player in this case is equal to 
A?(U,x m ,U,V,A) = a t (x c ['&o,U,x*,U,V,A})+ 

m-l , Tj+1 

/ gi(t,x c [t,t^,x^,U,V,A],u(Ti,x c [Tj,t^,x^,U,V,A]),v(Ti,x c [Tj,t^,x^,U,V,A})dt. 

3=0 Jt i 

Now we suppose that the Player II chooses a measurable control v[-}. Let 
x 1 [-, t*, x*, U, A, v[-]] be an unique solution of the problem 



x[t] = xln] + I f(£,x[£\,u(Ti,x[Ti\),v[£\)d£, te[Ti,T i+ i), i = 0, m-l, x[U]=x n 
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The value of cost functional of Player II in this case is equal to 
/4(U,x*,U,A,v[]) = (T i (x 1 [d ,t if ,x*,U, A, «[•]])+ 
^ p+i i 

2 t l 9i(t,x [t, t*, a;*, f7, A, v[-\], ufa, x c [tj, t*, sc*, ?7, A, «[•]]), v(t)dt. 
3=0 Jr i 

In the same way the case when the Player II deviates is considered. Denote the motion gen- 
erated by the strategy of the Player II and the control of the Player I by x 2 [•, f* , x* , V, A, u[>]] . 
The value of cost functional of Player I in this case is equal to 

A((U,x*,V,A,u[-\) = a i (x 2 ['do,t^x^V, A, «[■]])+ 

2J / 9i(t, x 2 [t, t*,x*, V, A, u[-]],u[t],x 2 [n, x 2 [rj, t t , x*, V, A, u[-]])dt. 

3=0 Jr i 

Let us introduce the following values: 

Ti(t m ,x*,U,V) = lim inf A?(t* ,x*,U, V, A) , 

d(A)lO 

Fi(t*,x*, V) = lim sup sup A j (t*, x* ; V, A, 
d(A)4.o «[•] 

^(i*, a:*, J7) = limsupsupA 2 (t*,x*, J7, A, «[•]). 

d(A)4.0 «[•] 

We say that the family of strategies is universal feedback Nash equilibrium on compact 
Dq C [toj^o] x if there exists nonnegative functions rji(a), i = 1,2, r]i(a) — ^ a — >• 0, 
such that for sufficiently small a the following inequalities are fulfilled for all (t* , x*) G Dq 

ri (i*, x, , r) < Ti (U , x*, C/° , V a ) + 771 (a) , 

r 2 (t*,x*,[/ a ) < T 2 (t„x„C/ a ,y a ) + r ?2 (a). 

In this paper we develop the approach based on system of Hamilton- Jacobi equations. 
The definition of Hamiltonians involves the Nash equilibrium in a static game. This game 
is an analog of a small game used in the theory of zero-sum games [1] . 

Define for (t, x) G [i , #o] x K n , p, q G M n , u G P, u G Q two criterions: 

Xi(i, sc,p, q, u, v) = (p, f(t, x, u, v)) + gi{t, x, u, v), 
X2(t,x,p,q,u,v) = (q,f(t,x,u,v)) + g 2 (t, x, u, v). 
Fix (t,x) G [io,#o] x K n , p,q G M n and consider the static games 

( Xi(t,x,p,q,u,v) ^ max ueP , 
\ Xs(t, x,p, q, u, v) ->■ max„ e Q . 

Denote the set of Nash equilibriums of game ([2]) by NE(t, x,p, q). Further we assume 
that for all (t,x) G [£oj$o] x P,9£R n the set NE(t, x,p, q) is nonempty. 
Remark 1. If the sets 

Oft 9, : u G P}, {X2(i,x,p,g,n*,7j) : v e Q} 

are convex for all (t,x) G [io^o] x K n , p,q <E M. n , G P, v* G Q t nen NE(i, a;,p, g) is 
nonempty. 

The pair of values (xi(t, x,p, q, u* , v*), X2(t, x,p, q, u* , v*)) for (u*,v*) G NE(t, x,p, q) is 
an analog of Hamiltonian. 
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3 Elements of Proximal Calculus 

In this section we follow the definitions from [5]. Let (f> : [to, $0] xR n -^Rbea continuous 
function. The vector (Ct~,CaT) £ K 1+n is said to be a proximal subgradient at the position 
(f,x), if there exists a constant a~ > such that for (t',x') sufficiently close to (t,x) the 
following inequality holds 

(f>(t', x') > <f>(t, x) + Ct"(t' - t) + (C",i' -x)-tr~ \\(t' - t, x' - x) || 2 . 

Analogously, the vector (Ct'Cx) ^ M 1+n is said to be a proximal supergradient at the 
position (t, x), if there exists a constant a + > such that for (t',x') sufficiently close to 
(t, x) the following inequality holds 

</>(t', a/) < s) + - t) + ((+, x' - x) + a+|| (t' - t, x' - x) || 2 . 

Denote the set of all proximal subgradients by dp(j)(t,x), the set of all proximal supergra- 
dients by dp(j)(t,x). 

Let Dq C [to,$o] x ^ n be a compact. Denote by D the reachable set from Dq. Let 

D x = {(t,x) € [t ,i9 ] x R n : ||r-t,x-y|| < 1, (t,x) <=£>}. (3) 
Let us introduce the following transformation of <p: 

(j) a (t,x)= max \(j>{T,y) - ||t - r, x - y|| 2 j . (4) 



Let (T a ,y a ) maximize the right hand of @ for the fixed position (t,x) € [toi^o] x 
Denote 

n^ = ^, n#* = ^r^ (5) 

or or 
In the same way we define the following transformation of the function cf> 
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mm 

(r,»)eDi 



{r,y) + 2~2"[l* -7",^ - 2/II 2 • ( 6 ) 



Let (T a ,y a ) minimize the right hand of ([6]). Denote 

(a[4>]t ~ ~ — (a[4>]x = 2° ' ■ ( 7 ) 
or or 

Lemmas 1-5 formulated below are analogs of lemmas 3.1-3.5 of [5]. Therefore lemmas 
1-5 are not proved here. In lemmas 1-5 we assume that the position (t, x) € D is fixed, 
(r a ,y a ) maximizes the right hand of (j3]), and (r a ,y a ) minimizes the right hand of @. 

Lemma 1. Let (r a ,y a ) be an inner point of D\, then 

{CMuU^ x )^d- p <P{T a ,x a ). 
Analogously, if(r a ,y a ) is an inner point of D\, then 

(( a [4,C a Mx)e9>(r a ,/). 

Let 

k\ = m.m{(p(t,x) : (t,x) G D{\, k 2 =max{(f)(t, x) : (t,x) € D±}, 



C 2 4 V2(fc 2 - h). (8) 
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Lemma 2. The following estimates are valid 

\\(t-r a ,x-y a )\\<C 2 a, \\(t - r a ,x - y a )\\ < C 2 a. 
Lemma 3. The following inequalities hold 

I I rj* /^j OC I | II '\J^~ I I ^ 

^2 ^ ^(C 2 a), — 2 < uJ4,{C 2 a). 

Here uj^ is a modulus of continuity of the function (ft on D\ . 
Following J5| we consider the sets 

F a [<ft]={(t,x)£D:T a = $ Q }, (9) 

F a W\ = {(t,x) eD:T a = V }. (10) 
Lemma 4. Let a G (0, 1/C 2 ). Then one of the following statements are fulfilled: 

• ((a[4>]t,Ca[4>]x) e d p (ft( 

1~a > Vol ) ! 

• (t,x) G F a and |i9 - T a \ < C 2 a. 

Analogously, one of the following statements is fulfilled: 

• (t,x) € F a and |0„ - r a \ < C 2 a. 

Lemma 5. For any 5 > and f G M n the following inequalities hold 

Mt + 5,X + 5f)< 4>a{t,x) + 6(( a [<ft] t + (ta[<j>U /)) + 7^(1 + ll/ll 2 ), 



<ft a (t + 5,x + 5f)> cft a (t, x) + 5{C[<ft]t + (Cleft)*, /)) - ^ (1 + ll/ll 2 )- 



2a 2 
2a 2 ' 



4 Main result 



Consider the functions (t,x,p,q) h-> u*(t,x,p,q), (t,x,p,q) v*(t,x,p,q) such that 
(u*(t,x,p,q),v*(t,x,p,q)) £ NE(t, x,p, q). Put 

Hi(t,x,p,q) = xi(t,x,p,q,u*(t,x,p,q),v*(t,x,p,q)), i = 1,2. 

Theorem. Suppose that there exist functions <p(t,x), ip(t,x), and oj(t, x, d) with properties: 

1. uj > 0, U}(t,x,d) —7-0 as d — > uniformly on any compact D, (t,x) G D. 

2. ^o,-) = ^i(0; 
5. #>o s -) = *2(0; 

^. a+ + ^i(t,x,p + ,g+) > -w(t,x,d) /or aZZ (a+,p+) G &£(p(0,z), {b + ,q + ) G fljtyfoy), 
such that || (r — t, y — x) || , || (9 — t, z — x) || < d; 

5. 6+ + %(t,a;,P + ,g + ) > -w(t,s,d) for all (a+,p+) G d+<p{6,z), (b + ,q+) G d+^(r,y) ; 
suc/i i/iat || (r — t, y — x) || , || (9 — t, z — x) || < d; 

6. a~ + ?ii(t,x,p~ ,q + ) < u)(t,x,d) for all (a + ,p + ) G dp(p(9,z), (b + ,q + ) G dp~ift(T,y), 
such that \\(t — t,y — x)\\,\\(9 — t, z — x)\\ < d; 
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7. b- +H 2 (T,y, P + ,q~) < u(t,z,T,y) for all (a+,p+) G d+<p(e,z), (b+,q+) G d+^{r,y), 
such that || (r — t, y — x) || , — t, z — x) || < d; 

TTien i/ie pair o/ strategies U a (t,x) = u*(t, x, ( a [ip] x , C a hP]x), V a (t,x) = 
v*(t, x, ( a [ip] x , C a bl>]x) "is Nash equilibrium on each compacts Dq. Here (C[ l f]t,C[ ( p]x), 
(C[ l l ; ]tjC[' l l'}x) o-re defined by formula f5|) at the position (t,x) for the functions (p and ip 
respectively. Moreover 

liminf Ti(t,x,[/ Q ,y Q ) = <p(t,x), 

a— s-0 

liminf T 2 (t,x,U a ,V a ) =ip(t,x). 

a->0 

Corollary. Suppose that one can choose the functions u*(t,x,p,q) and v*(t,x,p,q) such 
that its dependence on (i, x) is continuous. Moreover we assume that there exists a con- 
tinuous function (p(t,x), ip{t,x), and u(t,x,d) such that the conditions 1-3 of the Theorem 
hold and the following conditions are fulfilled: 

4'- a+ + Hi(t,x,p+,q+) > -ui(t,x,d) for all (a+,p+) G &£(p(t,x), (b+,q+) G d^(r,y), 
such that || (r — t, y — x)|| < d; 

3. b + + U 2 (t,x,p + ,q + ) > -co{t,x,d) for all (a+,p+) G d$<p(t,x), {b + ,q + ) G d£ip(r,y), 
such that || (r — t, y — x) || < d; 

&. a~ + ?ii(t,x,p~ ,q + ) < Ld(t,x,d) for all (a + ,p + ) G dpip(t,x), (b + ,q + ) G dpip(T,y), 
such that || (r — t, y — x)\\ < d; 

1. b- +H 2 (T,y,p + ,q-) <u(t,x,T,y) for all (a+ ,p+) 6^(t,i), {b+,q + ) e^(r,f/), 
such that || (r — t, y — x)\\ < d; 

Then the conclusion of the Theorem holds. 

Proof of the Theorem. Let us consider the compact Dq. Denote by D the reachable set 
from Dq. Also we assume that D\ is defined by ([3]). 
Put 

= {(0„, x) : x G M n } U F a [^} U F a [<p]. 

Let (t*, x*) G Do be an initial position. Let H = {£j}J_ be a partition of the interval [t*,i?o]- 
Further we will consider a motion of the system x[-], either x[-] = x[-,t*,x*,V,a,u[]], or 
x[-] = x[-, t*, a;*, £7, V, E]. For simplification we put Xj = x[£j]. 
Let a constant C3 be define by the rule 

C 3 = max{||/(t,x,n,u)|| : (t,x) e D l7 u £ P,v £ Q}. 

Also define 

Ci = {\gi(t,x,u,v)\ : (t,x) G D u u G P, u G Q}. 
Consider the following moduli of continuity on D\: 

w /(<5) - {\\f(t',x',u,v) - f(t",x",u,v)\\ : 

(t' , x'), (t" , x") G D\, u£P,v£Q, \t' - t"\ < S, \\x' - x"\\ < C 3 S}, 



- {\\9i{t',x',u,v) - gi(t" ,x" ,u,v)\\ : 

{t',x'),(t",x") G D x u£P,v£Q, \t' - t"\ < 6, \\x' - x"\\ < C 3 S}. 
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First we consider the case then the Player I deviates. We prove that for any control of 
the Player I u[-], the following inequality is valid 

Af (U, x*, V, S, u[-]) < <p(U, x*) + rj{a, d(S)), (11) 

where 

lim lim ri(a, 5) = 0. 

In this case we have x[-] = x[-, i*, x*, V a , S, Let / be a minimal number such that 

tei^&D e F*- Then by lemma 4 we have that |^ — 9q\ < C^a. Hence, ||x[i?o] — II < C^a. 
Then 



ai(xk? ]) = ¥>(0o,z[0o]) < <p(b,x[&])-2^ / 0i(M£],u[£],t; fc )d£ + ^(C*a) + C 4 a. 



We obtain the inequality 

r - x r?fc+ 
k=l J ^k 
Now let j < I. Denote 



^i(^^o]) + V/ 5i(^^[e],«[?],^)^<^(6^[6]) + ^(C*a) + C 4 a. (12) 



- A 1 

O+i - -/t , 



Put Uj = U a (^j, x[£j]), Vj = V a (£j, x[£j]) . Denote the position (T a ,y a ) for the function 
ip and {£j,x[£j]) by (rf Denote the corresponding pair (CaMt, CaM*) by (a~,p _ ). 

Analogously denote by (r^y^) the position (r a ,y a ) for 99 and (O^IO'D- Also denote the 
corresponding pair (( a [(p] t , ( a [<p] x ) by (a + ,p + ). Let the position (r a ,y a ) for ^ and (0, x[£j]) 
be denoted by (r^",y^"), the corresponding pair (C a Mt> C a Mx) be denoted (b + ,q + ). 
By lemma 3 we have inequalities 

<u v (C 2 a). 

By lemma 5 we obtain that 

^(0+i,z[0+iD < <p a (MZj]) + (O+i - 0)(«~ + <p~ /» + ( ^' +1 J^' )2 (i + ll/f) = 



MO^OD + (O+i - 0>~ + / + ^2 C 1 

^(O^IO]) + (O+i -0) a + / (p > u^],^- )}<*£+ 



(0 + i - 0)^(^0)^(0+1 - 0) + (0+1 a2 0)2 (i + ll/f) < 
^OD + (O+i - 0) a_ + (O+i - 0) ™ (p~> /(&> + fi(0, «> v i) 



/ si(Oz[0,«[0,^K + (O+i - 0Ki(0+i - 0)+ 
hi 



(0+i - 0)^(^0)^(0+1 - 0) + fe+1 Q2 ^ )2 (i + 11/11 2 ). (13) 
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a + max 



By the choice of Vj we have that 

{p~,f(€j,x[tZj],%Vj)) +9l(£j,v[(ij],u,Vj) = a" +Hi(£j,x[£j],p~,q + ). (14) 
It follows from the properties (a~,p~) € dp(p(r^ , yf), (a~,p~) G dpip(T2, yj), 

- 0,yr - sfe-DII, ll(r 2 + - o,y 2 + - zfoDII < c 2 « 

and condition [6] of the Theorem that 

a~ +H 1 (t,x,p~ ,q + ) < u(t{ ,yf ,C 2 a). (15) 

Put 

7(a) =sup{w(t / ,a/,(7 2 a) : (t',x') G D}. 

By the condition 1 of the Theorem we have that 7(a) — > 0, as a — > 0. From the inequalities 
(□3]), dm) and (USD it follows that 



^(O'^tOD + (0+1 ~0) 7(«) +^((720)^/(0+1 ~0) +U gi (0+1 -Ci) + 



(0+1 - 0)^2 



a- 



(16) 



Using the estimate (|16j) for j = 0, 1 - 1 we conclude that 



/-1 



fc=0 



(6, *[&]) + J] / 5i(0x[0,n[0,^)^< 



<£ a (**>£*) + (& - **) 7(") + ov(C 2 a:)a;/(£) + w 9l (5) + 



Here <5 = d(S). 
Since 



<Pa(&, > viZhxfa]) -^(a), 
using the inequality (fl~2|) we have that 



r-1 



fc=o 



ft 



(p a (t*,x*) + (i? -**) 7(a) + u v (C2<x)u}f(5) +uj gi (5) + ^fC* + 0^(0) + C 4 a + ^(a). 
Denoting 



?7(a, 5) = (i?o - *o) 7(") + w v ,(C 2 a)a;/(5) + w 5l (<5) + ^jC* +u (fl (C»a) + C4a + w f ,(a) ! 



we obtain the estimate (jlip . 

Now let us consider the case when the Player I and Player II use the strategies U a and 
V a respectively. Let x[-] denote the motion x c [-, t*, x*, U, V, H]. 

Put 

F* ={(#o,x) :xeR n }UF a [<p]UF a [ijj]. 



Let I be a minimal number such that (£z,a:[£z]) € F* . By lemma 4, |£j — 6q\ < C2OL. 
Therefore, ||x[$o] ~~ x [€i] II < C^a. Estimating the variation of the function (p we have that 

<T l (x[#o]) = <p(0 o ,x[0 o ]) >p(£i,s[6])- / 5l (e,x[e],n c (e,H), V c [e,H]K-^(aa)-C 4 a. 



Hence we conclude 

T - 1 f<k+i 



o"l(^Foj) + 2^ / 5i(0z[£],u fc ,u fc )d£ > ^te^fej) -u><p(C*a) -C 4 a. (17) 
fc=Z ■'S* 



Now let j < I. Denote 



0+i - ^ 



O+i - 4/ 

As to the rest we use the notations introduced above. By lemma 5 we obtain that 

Sfo+ll) > ^(O^OD + (0+1 "OX^ + - fe+ 2~ 2 ^ )2 (l + ll/f) = 

^•,xfeD + (0+1 - o> + + j^ + \ + ,f^m,u v v 3 )di))di - fe+ 2~ 2 ^ )2 ( 1 + 11/T) ^ 

^O'^tOD + (O+i - 0)[a + + (P + , /(O'^tOi^i^i)) + S'ltO'^OWj'^)]- 

siCf,^],^,^-)^ - (O+i - 0)(^(C2a)^/(0+i - 0) + w 9i(0+i - 0))- 

(0+1 ~ Q) 2 nl (iq\ 
2^ °*- (18) 

It follows from the definition of the strategies U a , V a and the elements Uj, Vj that 
« + + (p + ,f(Zj,x[£j],Uj,Vj)) +gi(£j,x[(ij],Uj,v j ) = a + +Ux{£j,x[£ >j \,p + ,q + ). 
By the lemma 2 we have that 

lki + " Zj>Vl " *[0HI, \\4 - 0^2 + " zfolll < C 2 a 
The condition [J] of the Theorem yields that 

a + + %{t, x,p + ,q + ) > —uj(t, x, C201). 

Using the function 7(-) we have 

a + +n 1 (^,x[( j ],p + ,q + ) > - 7 (a). 

From this and the inequality (|18p it follows that 

v(0+i' x [0+i]) + / gii^x^uj^j)^ > 

<p(£j,x[Zj]) ~ (0+1 " 0) [7(a) + w v (C7 2 a) W/ (^- + i - 0) + " fll (0+i - 0) + C * 



(19) 



Using the inequalities (|19p for j = 0, 1 — 1 we obtain that 
vte^&D + 2_> / 5i(£iZ[£]> u fc> u fc)df > 



fc=o 



a:*) - te - U)\pf(a) + u v (C 2 a)u f (8) +co gi (S) + t^C^. (20) 



Here 5 = d(E). Using the estimate (fT7|) and the property 
we conclude from (J2"0j) that 



A?(i*, a?*, [7°, V a , A) = <7(x[tf ]) + V 51 (£, «*, > 



- (i? - t*) 7(«) + u v {C2a)u)f(8) + + ~ <^v(a) - C 4 a - w v (a). 



(21) 
(22) 
(23) 
(24) 



Letting 5 to in (jlip and using the definition of 77 we obtain that 

ri(^,x*,U a ) < <p(i», 2*) + (i? -*o)7( Q! ) +w v (C*a) +C 4 a + w (/ ,(a). 

In the same manner we obtain from (|2ip that 

T[t*,cc*, £7", U a ] > c/?(i*,x*) - (i? - **)t(«) - ^v(a) - C 4 a - w^(a). 

Therefore 

T[t*,x*,V a ] - x{a) < <p(t*,x*) < T[t*,x*,U a ,V a ] 
Here 

>r(a) = (i?o - **)7(a) + + C 4 a + ^(a). 

The analog of the inequality (|24f) is fulfilled for the function of the Player II. Therefore the 
pair of strategies U a , V a is the universal Nash feedback. Moreover the payoffs of the Players 
I and the Player II at the position (i*,x*) are equal to x*) and ^(t^x*) respectively. 

□ 

Proof of the Corollary. In this case the inequalities (|22p and (|23p are still valid if we replace 
the function j(-) with the function 7(-) 

7(a) = 7(a) +uj ip {C2a)u* f {C 2 a) + u* gi (C 2 a), 

where is the following modulus of continuity 

c4(<5)4sup{||/(iV,u*(i>>, g )^^ : 
(t',x'),(t",x") eD x ,\\{t' -t",x' -x")\\ <8,\\p\\ < U(p {$),\\q\\ <aty(<y)}. 

The function is defined in the same way. Now let us consider the analog of the 

inequality (fl~4"|) . We use the designations introduced in the proof of the Theorem. We have 
that 



a + max 

ueP 



(P ,f(£j,x[£j],u,Vj)) + gi(£j,x[(;j],u,Vj) = 

a~ + (p~ , f (£j , xj , v* (£,• , Xj , p~ , q + ) , v* (£,• , xj , p~ , q + ) ) } + 

gi(€j,Xj,u*(£j,Xj,p~,q + ),v*(tj,Xj,p~,q + ) 
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Prom the lemma 3 and the definition of the function wj, we conclude that 

a~ + (p~,f{£j,x j ,u*(£ j ,x j ,p-,q + ),v*{£ j ,x j ,p-,q + ))} + 

91 (Cj ,Xj,u* (£j , Xj , p~ , q + ) , v* (Cj , Xj , p~ , q + ) < 
a~ + (P~ , f{r{ ,Vi ,u*(t{ ,p~ ,q + ),v*(r{ ,p~ ,q + ))) + 
9i (rf , Vi , u* (rf , y± ,p~, q + ), v* (rf , y{ , p~ , + ^^(^a)^^ (C 2 a) + w* a (C 2 a) = 

a" +Hi(rf ,yi ,p~,q + ) + uJ v (C 2 a)uj* f (C2a) +u* gl (C 2 a). 

Using the condition 6' we obtain the analog of the of the inequality ()22p . The analog of the 
inequality ([23]) is obtained in the same way. 

□ 
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